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Abstract. The first-order tlieory of a string automatic structure is known to be decidable, but 
there are examples of string automatic structures with nonelementary first-order theories. We 
prove that the first-order theory of a string automatic structure of bounded degree is decidable 
in doubly exponential space (for injective automatic presentations, this holds even uniformly). 
This result is shown to be optimal since we also present a string automatic structure of bounded 
degree whose first-order theory is hard for 2EXPSPACE. We prove similar results also for tree 
automatic structures. These findings close the gaps left open in [24] by improving both, the lower 
and the upper bounds. 

1 Introduction 

The idea of an automatic structure goes back to Biichi and Elgot who used finite automata 
to decide, e.g., Presburger arithmetic [IT]. Automaton decidable theories [T^ and auto- 
matic groups [12] are similar concepts. A systematic study was initiated by Khoussainov 
and Nerode [16] who also coined the name "automatic structure" (we prefer the term "string 
automatic structures" in this paper). In essence, a structure is string automatic if the ele- 
ments of the universe can be represented as strings from a regular language (an element can 
be represented by several strings) and every relation of the structure can be recognized by 
a finite state automaton with several heads that proceed synchronously. String automatic 
structures received increasing interest over the last years |5|17|15I3|18|20|1|23|21|27|2] . One 
of the main motivations for investigating string automatic structures is that their first-order 
theories can be decided uniformly (i.e., the input is a string automatic presentation and a 
first-order sentence). But even the non- uniform first-order theory is far from efficient since 
there exist string automatic structures with a nonelementary first-order theory. This moti- 
vates the search for subclasses of string automatic structures whose first-order theories are 
elementary. The first such class was identified by the second author in [23] who showed that 
the first-order theory of every string automatic structure of bounded degree can be decided in 
triply exponential alternating time with linearly many alternations. A structure has bounded 
degree, if in its Gaifman graph, the number of neighbors of a node is bounded by some fixed 
constant. The paper ^24j also presents a specific example of a string automatic structure of 
bounded degree, where the first-order theory is hard for doubly exponential alternating time 
with linearly many alternations. Hence, an exponential gap between the upper and lower 
bound remained. An upper bound of 4-fold exponential alternating time with linearly many 
alternations was shown for tree automatic structures (which are defined analogously to au- 
tomatic structures using tree automata) of bounded degree. Our paper [22] proves a triply 
exponential space bound for the first-order theory of an injective w-automatic structure (that 
is defined via Biichi-automata) of bounded degree. Here, injectivity means that every element 
of the structure is represented by a unique w-word from the underlying regular language. 
In this paper, we achieve three goals: 
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— We close the complexity gaps from [24J for string/tree automatic structures of bounded 
degree. 

— We investigate, for the first time, the complexity of the uniform first-order theory (where 
the automatic presentation is part of the input) of string/tree automatic structures of 
bounded degree. 

— We refine our complexity analysis using the growth function of a structure. This function 
measures the size of a sphere in the Gaifman graph depending on the radius of the sphere. 
The growth function of a structure of bounded degree can be at most exponential. 

Our main results are the following: 

— The uniform first-order theory for injective string automatic presentations is 2EXPSPACE- 
complete. The lower bound already holds in the non-uniform setting, i.e. there exists a 
string automatic structure of bounded degree with a 2EXPSPACE-complete first-order 
theory. 

— For every string automatic structure of bounded degree, where the growth function is 
polynomially bounded, the first-order theory is in EXPSPACE, and there exists an example 
with an EXPSPACE- complete first-order theory. 

— The uniform first-order theory for injective tree automatic presentations belongs to 4EX- 
PTIME; the non-uniform one to 3EXPTIME for arbitrary tree automatic structures, and 
to 2EXPTIME if the growth function is polynomial. Our bounds for the non-uniform prob- 
lem are sharp, i.e., there are tree automatic structures of bounded degree (and polynomial 
growth) with a SEXPTIME-complete (2EXPTIME-complete, resp.) first-order theory. 

We conclude this paper with some results on the complexity of first-order fragments with 
fixed quantifier alternation depth one or two on string/tree automatic structures of bounded 
degree. 

2 Preliminaries 

Let i"' be a finite alphabet and w £ F* he a finite word over F. The length of w is denoted 
by \w\. We also write -T" = {w £ F* \ n = \w\}. 

Let us define exp(0, x) = x and exp(n + l,x) = 2«'^p("'^) for x G N. We assume that the 
reader has some basic knowledge in complexity theory, see e.g. [26]. By Savitch's theorem, 
NSPACE(s(n)) C DSPACE(s(n)2) if s{n) > log(n). Hence, we can just write SPACE(s(n)'^(i)) 
for either NSPACE(s(n)<^(i)) or DSPACE(s(n)'^(i)). For k > 1, we denote with /tEXPSPACE 
(resp. /cEXPTIME) the class of all problems that can be accepted in space (resp. time) 
exp(fc,n°(i)) on a deterministic Turing machine. For lEXPSPACE we write just EXPSPACE. 
A computational problem is called elementary if it belongs to /cEXPTIME for some A; G N. 

2.1 Tree and string automata 

For our purpose it suffices to consider only tree automata on binary trees. Let be a finite 
alphabet. A finite binary tree over F is a mapping t : dom(t) F, where dom(t) C {0, 1}* is 
finite, nonempty, and satisfies the following closure condition for all w £ {0, 1}*: if {wO,wl}r] 
dom(t) 7^ 0, then also w,wO € dom(t). With Fp we denote the set of all finite binary trees 
over F. A (top-down) tree automaton over r" is a tuple A = [Q, A, qo), where Q is the finite 
set of states, qq £ Q is the initial state, and 

AC{QxFxQxQ)u{QxFxQ)u{QxF) (1) 
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is the non-empty transition relation. A successful run of A on a tree t is a mapping p : 
dom{t) Q such that (i) p{e) = qo and (ii) for every w £ dom(t) with children wO, . . . ,wi 
(thus — 1 < i < 1) we have {p{w) , t{w) , p{wO) , . . . , p{wi)) £ A. With L{A) we denote the set 
of all finite binary trees t such that there exists a successful run of ^ on t. A set L C Tp is 
called regular if there exists a finite tree automaton A with L = L{A). 

A tree t with dom(t) C 0* can be considered as a nonempty string t(e)i(0)t(00) . . . t(0"~^) 
with n = |dom(t)|. In the same spirit, a finite string automaton can be defined as a tree 
automaton, where the transition relation in ([T]) satisfies Z\ C (Q x i"' x Q) U (Q x i"'). 

We will need the following well known facts on string/tree automata: Emptiness (resp. 
inclusion) of the languages of string automata can be decided in nondeterministic logarithmic 
space (resp. polynomial space), whereas emptiness (resp. inclusion) of the languages of tree 
automata can be decided in polynomial time (resp. exponential time), see e.g. |8]. In all four 
cases completeness holds. 

2.2 Structures and first-order logic 

A signature is a finite set S of relational symbols, where every symbol r E 5 has some fixed 
arity m^. The notion of an 5-structure (or model) is defined as usual in logic. Note that we 
only consider relational structures. Sometimes, we will also use constants, but in our context, 
a constant c can be always replaced by the unary relation {c}. Let us fix an 5-structure 
A = {A, (r"^)r-g5), where r-^ C A"^'' . To simplify notation, we will write a £ A for a £ A. 
For B (1 A we define the restriction A\B = {B,{r'^ D B"^'')res)- Given further constants 
ai, . . . ,an £ A, we write {A, ai, . . . , a^) for the structure {A, (r-^)re5, ai, . . . , a^). In the rest 
of the paper, we will always identify a symbol r S 5 with its interpretation r-^. 

A congruence on the structure A = {A, {r)r<^s) is an equivalence relation = on A such 
that for every r £ S and all ai, 6i, . . . , a^,. , &m,. £ A we have: If (ai,...,Omr) £ and 
ai = bi, . . . , arrir = bnirj then also (6i, . . . , 6m^) G r. As usual, the equivalence class oi a £ A 
w.r.t. = is denoted by [a]= or just [a] and A/= denotes the set of all equivalence classes. 
We define the quotient structure A/= = {A/=, {r /=)r<^s), where r/= = {([ai], . . . , [om^]) | 
(ai, . . . ,am,) G r}. 

The Gaif man- graph G{A) of the 5-structure A is the following symmetric graph: 
G{A) = {A,{{a,h) £AxA \ \/ 3(ai,...,amJ £ r 3j,k: aj = a,ak = b}) . 

res 

Thus, the set of nodes is the universe of A and there is an edge between two elements, if 
and only if they are contained in some tuple belonging to one of the relations of A. With 
d^(a, 6), where a,b £ A, we denote the distance between a and b in G{A), i.e., it is the 
length of a shortest path connecting a and b in G{A). For a £ A and d > we denote with 
Sj[{d,a) = {b £ A \ dj[{a,b) < d} the d-sphere around a. If A is clear from the context, 
then we will omit the subscript A. We say that the structure A is locally finite if its Gaifman 
graph G{A) is locally finite (i.e., every node has finitely many neighbors). Similarly, the 
structure A has bounded degree, if G{A) has bounded degree, i.e., there exists a constant 6 
such that every a £ A is adjacent to at most 6 many other nodes in G{A); the minimal such 
S is called the degree of A. For a structure A of bounded degree we can define its growth 
function as the mapping (7_4 : N — > N with gj\_{n) = max{|5^(n, a)| | a £ A}. Note that if 
the function gj[ is not bounded then gj\_{n) > n for all n > 1. For us, it is more convenient 
to not have a bounded function describing the growth. Therefore, we define the normalized 
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Fig. 1. The convolution of two trees 

growth function g'j^ by g\{n) = max{n, (jr_4(n)}. Note that g_A^ and g'j^ are different only in 
the pathological case that all connected components of A contain at most m elements (for 
some fixed m). Clearly, g'j^{n) can grow at most exponentially. We say that A has exponential 
growth if g\{n) G 2^^"^; if g'_^{n) G n^^^\ then A has polynomial growth. 

To define logical formulas, we fix a countable infinite set V of variables, which evaluate 
to elements of structures. Formulas over the signature S (or formulas if the the signature is 
clear from the context) are constructed from the atomic formulas x = y and r(xi, . . . ,2;^^), 
where r £ S and x,y,xi, . . . , Xmr & ^ ■, using the Boolean connectives V and and existential 
quantification over variables from V . The Boolean connective A and universal quantification 
can be derived from these operators in the usual way. The quantifier depth of a formula ip is 
the maximal nesting of quantifiers in 99. The notion of a free variable is defined as usual. A 
formula without free variables is called closed. If '^{xi, . . . formula with free variables 

among xi, . . . , Xm and ai, . . . , S A, then A |= f{ai, . . . , Om) means that ip evaluates to 
true in A when the free variable Xi evaluates to Oj. The first-order theory of A, denoted by 
FOTh(^), is the set of all closed formulas ip such that A |= p. 



2.3 Structures from automata 

This section recalls string automatic and tree automatic structures and basic results about 
them. Details can be found in the survey [27j . 



Tree and string automatic structures String automatic structures were introduced 
in [Mj, their systematic study was later initiated by [16j. Tree automatic structures were 
introduced in [?], they generalize string automatic structures. Here, we will first introduce 
tree automatic structures. String automatic structures can be considered as a special case of 
tree automatic structures. 

Let -T be a finite alphabet and let $ ^ F be an additional padding symbol. Let ti, . . . ,tm £ 
Tp. We define the convolution t = ti<^ ■ ■ ■ <Sitm, which is a finite binary tree over the alphabet 
{ru {$})"*, as follows: dom(f) = UI^i dom(tj) and for all w G UI^Li dom(ij) we define t{w) = 
(oi, . . . ,am), where aj = ti{w) ii vu £ dom(tj) and = $ otherwise. In Fig. [H the third tree 
is the convolution of the first two trees. 

An m- dimensional (synchronous) tree automaton over F is just a tree automaton A over 
the alphabet {FU{$})"^ such that L{A) C {ti0 - ■ - (^tn \ ti, . . . , tm G Tp}. Such an automaton 
defines an m-ary relation 

RiA) = {(ti, ...,t^)\ti^---^tm€ L{A)} . 
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A tree automatic presentation is a tuple P = {F, Aq, A=, (^r)re5)) where: 

— r is a finite alphabet. 

— 5 is a signature (the signature of P), as before is the arity of the symbol r G S. 

— is a tree automaton over the alphabet P. 

— For every r £ S, is an mr-dimensional tree automaton over the alphabet P U {$} such 
that R{Ar) C LiAo)""-. 

— A= is a 2-dimensional tree automaton over the alphabet i"' U {$} such that R{A=) C 
L{Ao) X L{Aq) and R{A=) is a congruence on the structure {L{Aq), {R{Ar))r(^s)- 

This presentation P is called injective if R{A=) is the identity relation on L{Aq). In this case, 
we can omit the automaton A= and identify P with the tuple {P, Aq, {Ar)res)- The structure 
presented by P is the quotient 

AiP) = iL{Ao),{RiAr)Us)/RiA^) . 

A structure A is called tree automatic if there exists a tree automatic presentation P such that 
A ~ A{P). We will write [u] for the element (n G -L(Ao)) of the structure A{P). We 

say that the presentation P has bounded degree if the structure A{P) has bounded degree. 

A string automatic presentation is a tree automatic presentation, where all tree automata 
are in fact string automata (as explained in Section 12. 1|) , and a structure A is called string 
automatic if there exists a string automatic presentation P such that A — A{P). Typical 
examples of string automatic structures are (N,+) (Presburger's arithmetic), (Q, <), and all 
ordinals below uj'^ |16|10j . An example of a tree automatic structure, which is not string 
automatic is (N, •) (the natural numbers with multiplication) [4], or the ordinal lv'^ [lOj. 
Examples of string automatic structures of bounded degree are transition graphs of Turing 
machines and Cayley-graphs of automatic groups [12] (or even right-cancellative monoids 
[29]). 

Remark 2.1. Usually a tree automatic presentation for an 5-structure A = (A, (r)^^^) is 
defined as a tuple (-T, L, h) such that 

— is a finite alphabet, 

— L C is a regular set of trees, 

— /i : L — > A is a surjective function, 

— the relation {(u, u) G L x L | h{u) = h{v)} can be recognized by a 2-dimensional tree 
automaton, and 

— for every r G 5, the relation {(ui, . . . , Um^) £ I (^(^i), . . . , /i(Mm,. )) ^ can be 
recognized by an mr-dimensional tree automaton. 

Since for our considerations, tree automatic presentations are part of the input for algorithms, 
we prefer our definition, where a tree automatic presentation is a finite object (a tuple of 
finite tree automata), whereas in the standard definition, the presentation also contains the 
presentation map h. 
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We will consider the following classes of tree automatic presentations: 

SA = the class of all string automatic presentations 
SAb = the class of all string automatic presentations of bounded degree 
iSAb = the class of all injective string automatic presentations of bounded degree 

TA = the class of all tree automatic presentations 
TAb = the class of all tree automatic presentations of bounded degree 
iTAb = the class of all injective tree automatic presentations of bounded degree 

The model checking problem For the above classes of tree automatic presentations, we 
will be interested in the following decision problems. 

Definition 2.2. Let C be a class of tree automatic presentations. Then the first-order model 
checking problem FOMC(C) for C denotes the set of all pairs {P, ip) where P £ C, and ip is a 
closed formula over the signature of P such that A{P) |= y?. 

If C = {P} is a singleton, then the model checking problem FOMC(C) for C can be 
identified with the first-order theory of the structure A{P). An algorithm deciding the model 
checking problem for a nontrivial class C decides the first-order theories of each element of C 
uniformly. 

The following two results are the main motivations for investigating tree automatic struc- 
tures. 

Proposition 2.3 (cf. |16||4] ). There exists an algorithm that computes from a tree automatic 
presentation P = (F, (^r)re5) c-i^d a formula (^(xi,... ,Xm) an m- dimensional tree 

automaton A over P with R{A) = {{ui, . . . ,Um) £ L{Aq)"^ \ A{P) \= (p{[ui], . . . , [^im])}- 

The automaton is constructed by induction on the structure of the formula disjunction 
corresponds to the disjoint union of automata, existential quantification to projection, and 
negation to complementation. The following result is a direct consequence. 

Theorem 2.4 (cf. [1 6|l4] ). The model checking problem FOMC(TA) for all tree automatic 
presentations is decidable. In particular, the first-order theory FOTh(.A) of every tree auto- 
matic structure A is decidable. 

Remark 2.5. Strictly speaking, |16|4j device algorithms that, given a tree automatic presen- 
tation and a closed formula, decide whether the formula holds in the presented structure. But 
a priori, it is not clear whether it is decidable, whether a given tuple {r,AQ,A=, [Ar)r&s) is 
a tree automatic presentation. Lemma 12.81 below shows that TA is indeed decidable, which 
then completes the proof of this theorem. 

Theorem 12.41 holds even if we add quantifiers for "there are infinitely many x such 
that </7(x)" [4y5j and "the number of elements satisfying ip{x) is divisible by A:" (for /c E N) [loj^ . 
This implies in particular that it is decidable whether a tree automatic presentation describes 
a locally finite structure. But the decidability of the first-order theory is far from efficient, 

^ [19] only provides the prools for string automatic structures. These proofs are easily extended to tree auto- 
matic structures once the presentation is injective. But every tree automatic presentation can be transformed 
into an equivalent injective one [7] Cor. 4.2]. 
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since there are even string automatic structures with a nonelementary first-order theory [5]. 
For instance the structure ({0, 1}*, sq; si, where Sj = {{w,wi) \ w £ {0,1}*} for i £ {0,1} 
and :< is the prefix order on finite words, has a nonelementary first-order theory, see e.g. [9l 
Example 8.3]. A locally finite example (encoding the set of all finite labeled linearly ordered 
sets [25]) is as follows: the universe is the set L = {u v \ u £ {0, l}~^,v G 0*, |t;| < \u\}. In 
addition, we have a partial order {{u <^ v,u <^ v') £ L x L \ \v\ < \v'\} that encodes the union 
of all the linear order relations, and a unary relation {uf^iv £ L \ position \v\ in u carries 1} 
that encodes the labeling. 

First complexity results: the classes TA etc and boundedness This paper is concerned 
with the uniform and non-uniform complexity of the first-order theory of (some subclass of) 
tree automatic structures of bounded degree. Thus, we will consider algorithms that take as 
input tree automatic presentations (together with closed formulas) . For complexity considera- 
tions, we have to define the size |P| of a tree automatic presentation P = {F, Aq, A=, {Ar)r£s)- 
First, let us define the size |^| of an m-dimensional tree automaton A = (Q,A,qQ) over F. 
A transition tuple from A (see ([I])) can be stored with at most 31og(|(5|) -|- mlogd-Tl) many 
bits. Hence, up to constant factors, A can be stored in space |Z\| • (log(|(5|) + inlog{\F\)). We 
can assume that every state is the first component of some transition tuple, i.e., \Q\ < 
Furthermore, the size of the basic alphabet F can be bounded by \A\ as well, but the di- 
mension m is independent from the size of A. Since our complexity measures will be up to 
polynomial time reductions, it makes sense to define the size of the tree automaton A to be 
1^1 = \A\ ■ m. We assume A to be nonempty, hence \A\ > 1. The size of the presentation 
P = {F,Ao,A=, {Ar)rGs) is \P\ = \Ao\ + 1^=1 + Ere-S l^r-l- Note that \S\ < \P\ and m < \P\, 
when m is the maximal arity in S. 

It will be convenient to work with injective string (resp. tree) automatic presentations. 
The following lemma says that this is no restriction, at least if we do not consider complexity 
aspects. 

Lemma 2.6 (| ,16. Cor. 4.3] and fT, Cor. 4.2]). From a given P £ TA we can compute 
effectively P' £ iTA with A{P) ~ A{P'). If P £ SA, then P' £ iSA with A{P) ~ A{P') can be 
computed in time 2*^(1^1^ 

Remark 2. 7. In [7J, only the existence of an equivalent injective tree automatic presentation is 
stated, but the proofs of |7| Prop. 3.1 and Theorem 4.1] are effective although the complexity 
is difficult to extract. 

The following lemma shows that the classes of all tree and string automatic presentations 
are decidable and gives complexity bounds. While these two results are not surprising, it is not 
clear how to determine whether A{P) has bounded degree - this will be solved by Prop. [2?T0] 
below. 

Lemma 2.8. The class TA is in EXPTIME, and the class SA belongs to PSPACE. 

Proof. We start with a proof of the first statement. Suppose we are given a finite alphabet F, 
tree automata Aq over F, and multi-dimensional tree automata A= and A,, for r £ S over FU 
{$}. In a first step, we check that L{A=) and L{Ar) are languages of convolutions of elements 
of L(Aq), in particular 

L{Ar) Q L{Ao) L{Ao) ■ ■ ■ L{Ao) (2) 

^ V ' 

nir times 
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where is the arity of the automaton A^. An automaton for the right-hand side has size 
l^lol™"". Thus, the inclusion can be decided in time exponential in j^^l + l^ol™'^- Since rrir 
depends on the input, this yields a doubly exponential algorithm. Alternatively, we proceed 
as follows: 

(a) We check that no tree from L{Ar) contains the label ($,...,$). To this aim, replace in all 
transitions of Ar the letters from (r U {$})'"'■ \ {($,...,$)} by T and the letter ($,...,$) 
by _L and check whether the language of the resulting automaton A'^. is contained in T^jy 
(the set of all T-labeled binary trees). Since the set T^j} can be accepted by a fixed 
automaton, this inclusion can be decided in polynomial time. 

(b) Let H C rpu|$}. denote the set of those trees t whose -T-labeled nodes form an initial 
segment of t that belongs to L{Aq). To accept H, we extend Aq as follows (where a £ F): 

— We add a new state q$ and transitions ((/$,$), (9$, $,<?$), and (^$, $, g$, <?$)• 

— For each transition {p,a,q), we add the transition (p, a, q, q$). 

— For each transition (p, a), we add the transitions ip,a,q$) and ip,a,q$,q$). 

Let denote the resulting tree automaton and, for 1 < i < m^, let A\ denote the 
projection of A^ to its i^^ component. Then we check, for all 1 < i < rrir whether 
L(4) C L{AI) which can be done in exponential time. 

All these tests are passed if and only if ([2]) holds for A^. In particular, we can from now on 
speak of the relations R{A=) and R{Ar) over L{Aq). 

It remains to be checked that R{A=) is a congruence on the structure [L{Aq), {R[Ar))r&s)- 
For this, we proceed as follows 

(c) First build 2-dimensional tree automata and Aid of polynomial size with R{Ao) = 
R{A=) o R{A=), R{A^{) = R{A=)-^, and R{Ais) = {{t,t) \ t e L{Ao)}. Then check 
R{Ao) U R{A-i) U R{A[d) ^ R{A=) which can be done in exponential time. This test is 
passed if and only if R{A=) is an equivalence relation on L(Ao). 

(d) For each r G 5, first construct an 2mr--dimensional tree automaton A'^ such that the tuple 
(si, . . . , SfUrih, • • • ) tmr) belongs to R{A'j.) if and only if {si,ti) G R{A=) for all 1 < i < rrir 
and (ti, . . . ,tmr) £ R{Ar). This can be achieved by running nir copies of A= as well as 
one copy of Ar in parallel. Then project the automaton A'^ onto the first nir components 
and check whether the relation accepted by the resulting tree automaton is contained 
in R{Ar). Although A'^ has exponential size (since nir depends on the presentation P), 
this can be done again in exponential time: we complement Ar, take the intersection with 
A'r and check the resulting automaton (of exponential size) for emptiness. 

This finishes the proof of the first statement. To prove the second, one can proceed analogously 
using that the inclusion problem for string automata belongs to PSPACE. □ 

From the lower bounds for inclusion of string/tree automata, it follows easily that the upper 
bounds in Lemma 12.81 are sharp. 

The following lemma says that the Gaifman graph of a string (resp. tree) automatic 
structure is effectively string (resp. tree) automatic. This is an immediate consequence of 
Prop. 12.31 so the novelty lies in the estimation of the complexity. 

Lemma 2.9. From a given tree (string) automatic presentation P = (F, Aq, A=, {Ar)r£s) 
one can construct a 2-dimensional tree (string) automaton A such that 

R{A) = {{u,v) £ L{Ao) X L{Ao) \ {[u], [v]) is an edge of the Gaifman-graph G{A{P))} . (3) 

If m is the maximal arity in S, then A can be computed in time 0{vn? ■ \P\^) < 
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Proof. We only give the proof for string automatic presentations, the tree automatic case 
can be shown verbatim. Let E be the edge relation of the Gaifman-graph G{A{P)). Note 
that for all u,v £ L{Aq) we have {[u], [v]) £ E iff for some r G 5 of arity < m and 
1 < < rrir-, there exist ui, . . . ,Umr S L{Aq) with (ui, . . . , Um^) G i?(Ar), u = Ui, and 
f = Uj. Let r £ S and 1 < «,j < mj.. Projecting the automaton onto the tracks i and j, 
one obtains a 2-dimensional automaton accepting all pairs (u, v) £ F* x F* such that there 
exists (ni, . . . ,Umr) £ RiAr) with u = Ui and f = Uj. Then the disjoint union of all these 
automata (for r £ S and 1 < my) satisfies ([3]). Since |5| < |P|, the construction can be 

performed in time 0{m? ■ \P\^). □ 

Lemma 12.91 allows to show that also the bounded classes TAb etc. are decidable: 

Proposition 2.10. The following hold: 

(a) The class TAb is decidable. 

(h) The class iTAb can he decided in exponential time (in fact, it can he checked in polynomial 

time whether a given P £ iTA has hounded degree), 
(c) The class SAb can he decided in exponential time. 

Proof. For statement (a), let P £ TA (which is decidable by Lemma 12.81 in exponential 
time). By Lemma 12.61 we can assume P to be injective. By Lemma 12.91 we can compute an 
automaton A with ([3]), i.e., A defines the edge relation of the Gaifman-graph of A{P). Since 
P was assumed to be injective (i.e. every equivalence class [n] is the singleton {u}), A{P) 
is of bounded degree iff A (seen as a transducer) is finite-valued. But this is decidable in 
polynomial time [30|28j . This finishes the proof of (a). 

Next consider statement (b): Provided the input is guaranteed to be an injective tree 
automatic presentation, the polynomial time bound follows from the arguments above since 
there is no need to apply Lemma 12.61 It remains to decide whether the input is indeed an 
injective tree automatic presentation: Using Lemma [2.81 it suffices to decide injectivity which 
can be done in exponential time by checking inclusion of L[A=) in the convolution of the 
identity on Tp- 

For (c), where we start with a string automatic presentation (which can be decided in 
polynomial space and therefore exponential time by Lemma l2.8p . the initial application of 
Lemma [2.61 leads to an exponential blow-up, which gives in total an exponential running time 
for deciding the class SAb. □ 

Finally, since we deal with structures of bounded degree, it will be important to estimate 
the degree of such a structures given its presentation. Such estimates are provided by the 
following result. 

Proposition 2.11. The following hold: 

(a) If P £ iSAb, then the degree of the structure A{P) is bounded by exp(l, iPp^^^). 
(h) If P £ iTAb, then the degree of the structure A{P) is bounded by exp(2, |Pp(^)). 
(c) If P £ SAb, then the degree of the structure A{P) is bounded by exp(2, jPl'^^^)). 

Proof. For statement (a) let P £ iSAb. From Lemma |2.9| we can construct a string automa- 
ton A of size that accepts the edge relation of the Gaifman graph of A{P). Then the 
degree of A{P) equals the maximal outdegree of the relation R[A). For string transducer, 
this number is exponential in the size of A, i.e., it is in exp(l, |Pp^^^) |30j . 
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For (b) we can use a similar argument. But since the maximal outdegree of the relation 
recognized by a tree transducer A is doubly exponential in the size of A [28], we obtain the 
bound exp(2, for the degree of A{P). 

Finally statement (c) follows immediately from Lemma 12.61 and (a). □ 

The bounds on injective string (resp. tree) automatic presentations in Prop. 12.111 are 
sharp: Let En = {{uw,vw) \ u,v,w,£ {a,b}*,\u\ = \v\ = n}. Then the structure {{a,b}* , En) 
has an injective string automatic presentation of size 0{n). The degree of this structure 
is 2". Similarly, let E'^ the set of all pairs (ti,t2) £ ^{a,fe} ^ '^{a,b} of trees that differ at 
most in the first n levels. Then {T^^i,y,En) allows an injective tree automatic presentation 
of size 0(n) and the degree of this structure is doubly exponential in n. But it is not clear 
whether the doubly exponential bound for automatic presentations in Prop. 12.11( c) can be 
realized. Moreover, we cannot give any bound for general tree automatic presentations since, 
as already remarked, [7] does not provide any estimate on the size of an equivalent injective 
tree automatic presentation. 

3 Upper bounds 

It is the aim of this section to give an algorithm that decides the theory of a string/tree auto- 
matic structure of bounded degree. The algorithm from Theorem [23] (that in particular solves 
this problem) is based on Prop. [2^ i.e., the inductive construction of an automaton accepting 
all satisfying assignments. Differently, we base our algorithm on Gaifman's Theorem 13. H i.e., 
on the combinatorics of spheres. We therefore start with some model theory. 

3.1 Model-theoretic background 

The following locality principle of Gaifman implies that super-exponential distances cannot 
be handled in first-order logic: 

Theorem 3.1 (|13|). Let A be a structure, (ai, . . . , a^), . . . , 6^) G A'', d > 0, and 
Di, . . . ,Dk > 2*^ such that 

k k 

{A\{^S{D,,ai)), ai, . . . , Ofc 

i=l i=l 

Then, for every formula (/^(xi, . . . , Xk) of quantifier depth at most d, we have: 

^ 1= 99(01, ... ,afc) <;=^- ^ 1= 99(61, ... ,6fc) . 

Note that (JJ]) says that there is an isomorphism between the two induced substructures 
•^t(Ui=i S{Di, ai)) and ^|"(|J(L;^ S{Di, bi)) that maps to bi for all I < i < k. 

Let 5 be a signature and let k,d £ 'N with < A; < d. A potential {d, k) -sphere is a tuple 
{B, bi, . . . ,bk) such that the following holds: 

— ;B is an 5-structure with bi, . . . ,bk £ B. 

- For all b € B there exists 1 <i < k such that d^ih, b) < 2^~\ 
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There is only one (d, 0)-sphere namely the empty sphere 0. For our later applications, B will 
be always a finite structure, but in this subsection finiteness is not needed. The potential 
{d, A:)-sphere {B, hi, ... , h^) is realizable in the structure A if there exist Oi, . . . , G A such 
that 

k 

{A\{[j S{2^-\ a,)), ai, . ..,ak)^{BM,...M ■ 

1=1 

Let a = {B,bi, . . . ,bk) be a potential (d, A;)-sphere and let a' = {B' ,b'i, . . . ,b'^,b'^_^i) be a 
potential (d, k + l)-sphere {k + 1 < d). Then a' extends a (abbreviated a ■< a') if 

k 

{B' KU S{2^~\h)), 6',) ^{BM,....bu) . 

1=1 

The following definition is the basis for our decision procedure. 

Definition 3.2. Let A be an S-structure, ipd/i, . . . ,yk) a formula of quantifier depth at 
most d, and let a = {B, bi, . . . , b^) be a potential (d + k, k)-sphere. The Boolean value ipa- G 
{0, 1} is defined inductively as follows: 

— If ipivi, ■ ■ ■ ,yk) is an atomic formula, then 

— If tp = -10, then ip„ = 1 — Ofj- 

— If Tp = ay P, then ip^ = max(Qo-, /3cr) • 

— Ifip{yu---,yk) = ^yk+iO{yi,...,yk,yk+i) then 

tp^ = maxj^o-' \ ct' is a realizable potential (d + k,k + l)-sphere with a ^ a'} . (6) 

The following result ensures for every closed formula ip that ipijf = 1 if and only if ^ \= tp- 
Hence the above definition can possibly be used to decide validity of the formula ip in the 
structure A. 

Proposition 3.3. Let S be a signature, A an S-structure with oi, . . . , Ofc £ A, ip{yi, • • • , yk) 
a formula of quantifier depth at most d, and a = {B, bi, . . . , b^) a potential {d + k, k)-sphere 
with 

k 

iA\i\JSi2''+''-\a,)), ai,...,ak)c^{B,bi,...,bk) . (7) 

i=l 

Then A \= tp{ai, . . . ,ak) <^=^ ip^ = 1- 

Proof. We prove the lemma by induction on the structure of the formula ip. First assume that 
ip is atomic, i.e. d = 0. Then we have: 

V'. = 1 A B^^P{bu...,bk) 

k 

M A\{{JS{2'-\a,))^i;{ai,...,a,) 

i=l 

A 1= ipiai,. ..,ak) , 
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where the last equivalence holds since ip is atomic. 

The cases ip = ^9 and ip = ay (5 are straightforward and therefore omitted. 

We finally consider the case '0(2/1, ■■■,yk) = 3yk+i0iyi, ■■■,yk, yk+i)- 

First assume that = 1. By ([6]), there exists a realizable potential {d + k,k + l)-sphere 

a' with a ^ a' and 6a-' = l- Since a' is realizable, there exist a'^, . . . , a'^, a'^_|_i G -4 with 

fc+1 

Mr( U Si2^''''-\a[)), . . . , 4, (^', 6i, . . . , = a' . (8) 

i=l 

By induction, we have A |= 0{a[, . . . and therefore A |= V'(«i) • • • ,4)- From ([7]), 

dS]), and cj :^ o"', we also obtain 

fc fc 

i=i i=i 

and therefore by Gaifman's Theorem 13.11 ^ |= ip{ai, . . . , Ofc). 

Conversely, let a^+i G ^ with ^ |= 0{ai, . . . , a^, afc+i). Let a' = {B', bi, . . . ,bk, bk+i) be 
the unique (up to isomorphism) potential {d + k,k + l)-sphere such that 

fc+1 

iA\{\JS{2''+''-\ai)), ai,...,ak,ak+i)^{B',bu...,bk,bk+i) . (9) 

i=l 

Then ([7]) implies a ^ a' . Moreover, by Q, cr' is realizable in A, and ^ |= 6'(ai, . . . , a^, flfc+i) 
implies by induction 9fj' = 1- Hence, by ([6]), we get ipa = ^ which finishes the proof of the 
lemma. □ 



3.2 The decision procedure 

Now suppose we want to decide whether the closed formula ip holds in a tree automatic 
structure A of bounded degree. By Prop. [3T3l it suffices to compute the Boolean value (/50. This 
computation will follow the inductive definition of (pa from Def. 13.21 Since every (d, A;)-sphere 
that is realizable in A is finite, we only have to deal with finite spheres. The crucial part of 
our algorithm is to determine whether a finite potential {d, A;)-sphere is realizable in A. In 
the following, for a finite potential (d, A;)-sphere a = {B,bi,... ,bk), we denote with |cj| the 
number of elements of B and with 5 {a) we denote the degree of the finite structure B. We 
have to solve the following realizability problem: 

Definition 3.4. Let C be a class of tree automatic presentations. Then the realizability prob- 
lem REAL(C) for C denotes the set of all pairs {P,cr) where P G C and a is a finite potential 
{d, k) -sphere over the signature of P for some < k < d such that a can be realized in A{P). 

Lemma 3.5. The problems REAL(iSA) and REAL(iTA) are decidable. More precisely: 

— Let P G iSA and let m be the maximal arity of a relation in A{P) . Let a be a finite potential 
{d, k)-sphere over the signature of P. Then it can be checked in space \a\'-'^'^^ . |p|2 .2C('5(o-)) ^ 
whether a is realizable in A{P). 

— If P G iTA, then realizability can be checked in time exp(l, Icjp^™'-' • |Pp • 2^^^^°'^^). 
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Proof. We first prove the statement on injective string automatic presentations. Let P = 
(r, Aq, {Ar)r£s) £ iSA. Let a = {B, bi, . . . ,bk) and let ci, . . . , C|o-| be a list of all elements 
of B. Note that every 6j occurs in this list. Let E_^i^p-j be the edge relation of the Gaifman 
graph G{A{P)) and E13 that of the Gaifman graph G{B). Then a is realizable in A{P) if and 
only if there are words ui, . . . , G F* such that 

(a) Ui G L{Ao) for all 1 < i < |cr|, 

(b) Ui 7^ Uj for all 1 < i < J < \a\, 

(c) (uii , . . . , ) G ii(A^) for all r G 5 and all {ci^ , . . . , Ci„,. ) G r^, 

(d) (uii , . . . , Ui,„^ ) ^ RiAr) for all r G 5 and all {a, ) G S"^'' \ r^, and 

(e) there is no f G L{Ao) such that, for some 1 < j < |cr| and 1 < z < /c with d(cj, hi) < 2"^"*, 
we have 

(e.l) {uj,v) G Eji^i^p-^ and 
(e.2) w ^ {up I (cj,Cp) G ^b}. 

Then (a-d) express that the mapping Cj 1-^ Ui is well-defined and an embedding of into A{P). 
In (e), {uj,v) G Ej^^(^p) implies that v belongs to [Ji^^^j^ S{2'^~^ ,Ui). Hence (e) expresses that 
all elements of Ui<j<fc S{2'^~'^,Ui) belong to the image of this embedding. 

We now construct a |(j| -dimensional automaton A over the alphabet P that checks (a-e). At 
the end, we have to check the language of this automaton for non-emptiness. The automaton A 
is the direct product of automata Aa, Af,, Ac, A^, and Af> that check the conditions separately. 
Then Aa is the direct product of |cr| many copies of the automaton Aq, hence Aa has at most 
many states. 

Next, the automaton for (b) is the direct product of 0(|c7p) many copies of an automaton 
of fixed size (that checks whether two tracks are different). Hence, this automaton has 21^^!°'^' 
many states. 

The automaton Ac is again a direct product, this time of one automaton for each r G 5 
(and therefore of at most |P| many automata). Each of these automata is the direct product 
of \r^\ many copies of the automaton A^. Since the arity of r G 5 is bounded by m, we 
have \r^\ < |o"|™'. Hence, the automaton A^ has at most (|P|I'^I'")I^I = iPll^l'kl™ many 
states. For A^, we can argue similarly, but this time using copies of the complement of the 
automaton A^. This yields for A^ the bound (2l^l)l-^l'l'^l'" = exp(l, |Pp • |ct|'") on the number 
of states. 

It remains to construct the automaton A(.. For this, we first construct its complement, i.e., 
an automaton A'^ that checks for the existence of f G L{Aq) with the desired properties. This 
automaton A'^ is the disjoint union of at most \(t\ many automata, one for each 1 < j < \a\ 
such that there exists 1 < i < k with d{cj, hi) < 2'^"'. Any of these components consists of the 
direct product of automata A^ i and Ae.2 checking (e.l) and (e.2), respectively. By Lemma [2.9t 
^e.i hast at most tv? ■ |Pp many states. Recall that the degree of B is S{a). Hence, the set 
{up I {cj,Cp) G Eis} contains at most 6{a) many elements. Thus, (e.2) can be checked by an 
automaton Ae.2 with 2'^^^^"^^ many states. Hence, A'^ is the disjoint union of at most |cj| copies 
of an automaton of size |Pp • ■ 2'^^^^'^^^ and therefore has at most \a\ ■ |P|^ • • 2'-^^^^'^^^ 
many states. Now the number of states of A^ can be bound by exp(l, • |Pp • ■ 2^^^^"^'>). 

In summary, the automaton A has at most 

|P|H . 2lH°<'> . \p\\P\-Wr . 2\P\^-Wr . 2W\-\P\^-m^-20W-)) < g^p(^^ |^|OM . |p|2 . 20('5M)) 
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many states. Hence checking emptiness of its language (and therefore realizability of a in 
A{P)) can be done in space logarithmic to the number of states, i.e., in space |cr|'^(™) • |Pp • 
20(5('^)) which proves the statement for string automatic presentations. 

For injective tree automatic presentations, the construction and size estimate for A are 
the same as above. But emptiness of tree automata can only be checked in deterministic 
polynomial time (and not in logspace unless NL = P). Hence, emptiness of A can be checked 
in time exp(l, |cj|'^('") • jPp • 2'^^'^))). □ 

In the following, for a tree automatic presentation P of bounded degree, we denote with 
g'p = ^^(-p) the normalized growth function of the structure A{P). 

Theorem 3.6. The model checking problem FOMC(TAb) is decidable, i.e., on input of a 
tree automatic presentation P of hounded degree and a closed formula ip over the signature 
of P, one can effectively determine whether A{P) |= ip holds. More precisely (where m is the 
maximal arity of a relation from the signature of P): 

(1) FOMC(iSAb) can he decided in space 

5^(2l^l)OM . exp(2, |P|^«) < exp(2, |P|^« + \<p\) . 

(2) FOMC(SAb) can he decided in space 

exp(3,0(|P|)+log(|(/p|)) . 

(3) FOMC(iTAb) can he decided in time 

exp(l, ff^(2M)0(-).exp(3,|P|««)) < exp(4, |Pp« + log(|(^|)) . 

Proof. The decidability follows immediately from Theorem 12.41 and Prop. [ZiTOl a). 

We first give the proof for injective string automatic presentations. By Prop. [331 it suffices 
to compute the Boolean value . Recall the inductive definition of (pa- from Def . 13.21 that we 
now translated into an algorithm for computing (/?0. 

First note that such an algorithm has to handle potential (d, A;)-spheres for 1 <k < d <\ip\ 
[d is the quantifier rank of (p) that are realizable in A{P). The number of nodes of a potential 
(d, /!:)-sphere realizable in A{P) is bounded by k ■ g'p{2'^) G g'p{2'^)^'^^^ since k < d < 2'^ < 
g'p{2'^). The number of relations of ^(P) is bounded by |P|. Hence, any potential {d, A;)-sphere 
can be described by |P| • g'p {2'^)'^^"^^ many bits. 

Note that the set of (d, fe)-spheres with < k < d (ordered by the extension relation ^) 
forms a tree of depth d+1. The algorithm visits the nodes of this tree in a depth- first manner 
(and descents when unraveling an existential quantifier). Hence we have to store d + 1 many 
spheres. For this, the algorithm needs space (d + 1) • |P| • 5p(2'^)<^(™) = |P| • g'p{2'^)'^^"'\ 

Moreover, during the unraveling of a quantifier, the algorithm has to check realizability 
of a potential (d, A;)-sphere for 1 < k < d < \p\. Any such sphere has at most g'p (2'^)'-''^^^ 
many elements and the degree 5 of ^ is bounded by exp(l, |Pp(^)) by Prop. 12.111 Hence, 
by Lemma 13. 5( realizability can be checked in space g'p{2'^)^^'^^ ■ |Pp • exp(2, IPI*^*-^-*) < 
c,^(2l^l)OM .exp(2,|P|OW). 

At the end, we have to check whether a tuple h satisfies an atomic formula il^ijj), which is 
trivial. In total, the algorithm runs in space 

|P| • 5^(2l^l)^(") + g'p{2\^\ f^'^^ ■ exp(2, |P|°(i)) < 5^(2l'^l)^('") • exp(2, |P|°(^)) . 
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Recall that g'_^{2M) < -J^'^' and 6 < 21^1°*'^ by Prop.[MIl Since also m < \P\, we obtain 

g'^(^2\^\fim) . g^p(2^ \P\OW) < exp(l, • 2l^l • 0(m)) • exp(2, \P\^^^^) 

<exp(2,|Pp« + |(^|) . 

This completes the consideration for injective string automatic presentations. 

If P is just automatic, we can transform it into an equivalent injective automatic presen- 
tation which increases the size exponentially by Lemma 12.61 Hence, replacing |P| by 2^^^^^^ 
yields the space bound. 

Next, we consider injective tree automatic presentations. The algorithm is the same, i.e., 
it parses the tree of all potential (d, /i;)-spheres and checks them for realizability. Note that the 
number of potential {d, fe)-spheres is in exp(l, |P| • g'p{2'^)^^^^). By Prop. 12.111 the degree 5 
is bounded by exp(2, Hence, by Lemma 13.51 the realizability of any potential {d,k)- 

sphere can be checked in time 

exp^^l, 5:^(2'^)^(") • |P|2.exp(3,|P|^«)j <exp^l, 5^(2l^l)0("^) • exp(3, j . 

Recall that 5p(2l'^l) < 5^'^' and 6 < exp(2, by Prop. EUl Since also m < \P\, we 

obtain 

^^(2l^l)OM . exp(3, < exp(2, \p\0{i)f-^-oi\P\) . ^^^^^^ |p|0(i)) 

= exp(2, + |(^|) • exp(3, 

= exp(3,|P|««+log(|(^|)) . 

□ 

Remark 3.7. Note that the above theorem does not give the complexity for FOMC(TAb), i.e., 
for arbitrary tree automatic presentations of bounded degree: Here, one can proceed as for 
string automatic presentations, i.e., make the presentation injective and refer to the above 
result on FOMC(iTAb) - this gives the decidability that we already know from Theorem 12.41 
and Prop. 12.101 At present, we cannot compare the complexity of this new algorithm with 
the nonelementary one from Theorem 12.41 since the size of the injective presentation is not 
known. 

We derive a number of consequences on the uniform and non-uniform complexity of the 
first-order theories of string/tree automatic structures of bounded degree. The first one con- 
cerns the uniform model checking problems and is a direct consequence of the above theorem. 

Corollary 3.8. The following holds: 

- The model checking problem FOMC(iSAb) belongs to 2EXPSPACE. 

- The model checking problem FOMC(SAb) belongs to 3EXPSPACE. 

- The model checking problem FOMC(iTAb) belongs to 4EXPTIME. 

Next we concentrate on the non-uniform complexity, where the structure is fixed. For 
string automatic structures, we do not get a better upper bound in this case (statement (i) 
below) except in case of polynomial growth (statement (ii) below). 
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Corollary 3.9. Let A be a string automatic structure of bounded degree. 

(i) Then FOTh(^) belongs to 2EXPSPACE. 

(ii) If A has polynomial growth then FOTh(^) belongs to EXPSPACE. 

Proof. Since A is string automatic, it has a fixed injective string automatic presentation P, i.e., 
|P| and m are fixed constants. Hence the result follows immediately from (1) in Theorem 13.61 
Now suppose that A has polynomial growth, i.e., g'_^{x) E x^^^\ Then, again, the claim 
follows immediately from (1) in Theorem[Ml since 5^(2l^l)'^(™) < 2^^Ml □ 

The last consequence of Theorem 13.61 concerns tree automatic structures. Here, we can 
improve the upper bound from Theorem 13.61 for the non-uniform case by one exponent. In 
case of polynomial growth, we can save yet another exponent: 

Corollary 3.10. Let A be a tree automatic structure of bounded degree. 

(i) Then FOTh(^) belongs to 3EXPTIME. 

(ii) If A has polynomial growth then FOTh(^) belongs to 2EXPTIME. 

Proof. Since A is tree automatic, it has a fixed injective tree automatic presentation P. Hence, 
again, the first claim follows immediately from (3) in Theorem 13.61 

Now suppose that A has polynomial growth, i.e., g'_^{x) £ x'-'^^\ Then the claim follows 
since 

exp(l,5:4(2l'^')''^"^^)<exp(l,20(M)) = exp(2,0(|<^|)) , 
implying that the problem belongs to 2EXPTIME. □ 

Two observations on the growth function We complement this section with a short 
excursion into the field of growth functions of automatic structures. The two results to be 
reported indicate that these growth functions do not behave as nicely as one would wish. 
Fortunately, these negative findings are of no importance to our main concerns. 

Recall that the growth rate of a regular language is either bounded by a polynomial from 
above or by an exponential function from below and that it is decidable which of these cases 
applies. The next lemmas show that the analogous statements for growth functions of string 
automatic structures are false. 

Lemma 3.11. There is a string automatic graph of intermediate growth (i.e., the growth is 
neither exponential nor polynomial). 

Proof. Let L = {0, 1}*${0, 1}* and let E be 

{{u$bv,ub$v) \u,v£ {0,1}*, be {0,1}} U {(^$,$^6) | u £ {0,1}*,6 G {0,1}} . 

Then T = {L, E) is a string automatic tree obtained from the complete binary tree ${0, 1}* 
by adding a path of length n between u and ub for u € {0, 1}" and b G {0, 1}. Hence, a path of 
length n starting in the root $ of T branches at distance 0, 2, 5, 10, . . . , + 1, . . . , [V"- — Ij ^ + 1 
from the root. Hence, for the growth function gx we obtain the following estimate: 

e(v^) 

grin) G ^ (i + 1) • 2* = e{^) ■ 2®(v^) = 2^(^^) 

i=0 

□ 
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Lemma 3.12. It is undecidable whether a string automatic graph of bounded degree has poly- 
nomial growth. 

Proof. We show the undecidabihty by a reduction of the halting problem (with empty input) 
for Turing machines. So let be a Turing machine. We can transform N into a deterministic 
reversible Turing machine M such that: 

(i) N halts on empty input if and only if M does so. 

(ii) M does not allow infinite sequences of backwards steps (i.e., there are no configurations 
Cj with Cj+i hjv/ Ci for all i G N), see also |21) for a similar construction. 

Let C be the set of configurations of M (a regular set) and cq the initial configuration with 
empty input. Now define L = ({0, 1}C)^ (we assume that and 1 do not belong to the 
alphabet of C) and 

E = {{uac, uac) \ u £ LU {e}, a G {0, 1}, c, c £ C,c \-m c'} U 

{(nac, uacbco) \ u £ LU {e}, a,b £ {0, l},c £ C is halting} . 

Then (L, E) is an automatic directed graph. Since M is reversible, it is a forest of rooted trees 
(by (ii)). 

First suppose there are configurations ci,C2, . . . ,Cn with q-i \-m Ci iov 1 < i < n such 
that Cn is halting. Then the set 0(cn{0, l})*{co, ci, . . . , Cn} forms an infinite tree in {L,E). 
Any branch in this tree branches every n steps. Hence (L, E) has exponential growth. 

Now assume that cq is the starting point of an infinite computation. Let T be any tree 
in the forest {L,E). Then its root is of the form uac £ L with u £ LU {e}, a £ {0, 1}, and 
c £ C such that c is no successor configuration of any other configuration. There are two 
possibilities: 

1. The configuration c is the starting configuration of an infinite computation of M. Then T 
is an infinite path. 

2. There is a halting configuration c' and n G N with c c'. Then T starts with a path of 
length n. The final node of this path has two children, namely uac'Oco and uac' Icq. But, 
since M does not halt on the empty input, each of these nodes is the root of an infinite 
path. 

Thus, in this case (L, E) has polynomial (even linear) growth. □ 
4 Lower bounds 

In this section, we will prove that the upper complexity bounds for the non-uniform problems 
(Cor. [3^ and Cor. 13.10]) are sharp. This will imply that the complexity of the uniform problem 
for injective string automatic presentations from Theorem 13.61 is sharp as well. 

For a binary relation r and m G N we denote with r™ the m-fold composition of r. Then 
the following lemma is folklore. 

Lemma 4.1. Let the signature S contain a binary symbol r. From a given number m (encoded 
unary), we can construct in linear time a formula (pmix,y) such that for every S-structure A 
and all elements a,b £ A we have: (a, b) £ if and only if A |= (/7m(0) b). 
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Proof. Let ipQ{x,y) = r{x,y) and, for m > define 

ipmix,y) = 3z'\/x,y'{{{x' = x A y' = z) y {x = z A y = y)) ^ ipm^i{x' ,y')) . 

□ 

For a bit string u = ai - ■ ■ am (ai € {0, 1}) let val(n) = X^S)^ ai+i2* be the integer value 
represented by u. Vice versa, for < i < 2™ — 1 let binm(«) G {0, 1}™' be the unique string 
with val(binm(i)) = i. 

Theorem 4.2. There exists a fixed string automatic structure A of bounded degree such that 
FOTh(^) is 2EXPSPACE-/iard. 

Proof. Let M be a fixed Turing machine with a space bound of exp(2, n) such that M accepts 
a 2EXPSPACE-complete language; such a machine exists by standard arguments. Let F be 
the tape alphabet, i7 C be the input alphabet, and Q be the set of states. The initial 
(resp. accepting) state is qo £ Q (resp. qf G Q), the blank symbol is □ G r" \ Z". Let 
f2 = QD r. A configuration of M is described by a string from r*Qr'^ C i7+ (later, symbols 
of configurations will be preceded with additional counters). For two configurations u and 

V with \u\ = \v\ we write u \-m v \i u can evolve with a single M-transition into v. Note 
that there exists a relation OAf ^ ^^'^ x such that for all configurations u = ai - ■ ■ am and 

V = bi - ■ - bm {ai,bi £ f2) we have 

u\-MV <^ yi £ {1, . . . ,m -2} : {aiai^iai+2,bibi+ibi+2) ^ aM- (10) 

Let A = {0, 1, #}U J7, and let vr : Z\ ^ f2[j{^} be the projection morphism with TT{a) = a for 
a £ f2u{^} and '7r(0) = '7r(l) = e. For m G N, a string x £ A* is an accepting 2"^ -computation 
if x can be factorized as x = 2;i#X2# • • • for some n > 1 such that the following holds: 

— For every 1 < i < n there exist ai^, . . . , aj^2'"-i G i? such that Xi = llj=o binm(jjajj. 

— For every 1 < i < n, Tr{xi) £ r*Qr~^. 

— 7r(xi) G qoS*\J* and 7r(xn) G r*qfr+ 

— For every 1 < i < n, 7r(xi) 1-^./ 7r(xj+i). 

From M we now construct a fixed string automatic structure A of bounded degree. We start 
with the following regular language Uq: 

Uo =7r~H{r*Qr+#y)n (ii) 

(0+I?({0,l}+i7)*l+I2#)+ n (12) 

o+<?o({o, i}+i7)*({o, i}+n)*#z\* n (is) 

A*qf{A\ {#})*# (14) 

A string x G f/o is a candidate for an accepting 2'"-computation of M. With (jlip we describe 
the basic structure of such a computation, it consists of a list of configurations separated 
by 7^. Moreover, every symbol in a configuration is preceded by a bit string, which represents 
a counter. By (|12p every counter is non-empty, the first symbol in a configuration is preceded 
by a counter from 0^, the last symbol is preceded by a counter from 1^. Moreover, by (|13p . 
the first configuration is an initial configuration, whereas by ()14p . the last configuration is 
accepting (i.e. the current state is qf). 

For the further considerations, let us fix some x G Uq. Hence, we can factorize x as 
X = xi#X2# • • • Xn# such that: 
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- For every 1 < i < n, there exist nii > 1, Qi^o, . . . , ai^^ni £ ^ and counters itj^O) ■ ■ ■ ■> '^i,mi £ 
{0, 1}+ such that Xi = Hjlio 

- For every 1 < z < n, ui^q G 0+, Uj,^. G 1+, and '^{xi) G r*Qr'^. 

- Tr{xi) e qoS*n* and 7r(xn) G r*g/r+ 

We next want to construct, from m G N, a small formula expressing that x is an accepting 
2'"-computation. To achieve this, we add some structure around strings from Uq. Then the 
formula we are seeking has to ensure two facts: 

(a) The counters behave correctly, i.e. for all 1 < i < n and < j < rrij, we have \uij\ = m 
and if J < m,, then val(tijj_|_i) = val(tijj) + 1. Note that this enforces = 2™" — 1 for all 
1 < i < n. 

(b) For two successive configurations, the second one is the successor configuration of the first 
one with respect to the machine M, i.e., TT{xi) \-m T^ixi+i) for all 1 < i < n. 

In order to achieve (a), we introduce the following three binary relations; it is straightforward 
to exhibit 2-dimensional automata for these relations: 

S = {{w, w <Si w) \ w E Uo} 
(^0 = { ((0i;i#0i;2# • • • Ovn#) ® w, (i;i0#^;20# • • • VnO#) ® w) \ 

W G Uo,Vi,...,Vn G (Z^\ {#})*} 
= {((ai'yi#a2^^2# • • • anVnif) ® W, {viai#V2a2# ■ ■ ■ Vnttnif) ® w) I 

w G J7o,ai,...,a„ G G {#})*} 

Hence, 5 just duplicates a string from and cyclically rotates every configuration to 
the left for one symbol, provided the first symbol is 0, whereas gq rotates symbols from Q. 
Moreover, let Ui be the following regular language over A* ® A*: 

Ui = (^{{u^v\u,v e {0, 1}+, l^l = |i;|, val(u) = val(t;) + 1 mod 2l"l}(/2 x 
Clearly, f/i is a regular language. The crucial fact is the following: 

Fact 1. For every m G N, the following two properties are equivalent (recall that x G Uo): 

- There exist yi, 1/2,^3 G Z\* Z\* such that 5{x,yi), a^{yi,y2), o-|?(y2, 2/3), Vs G Ui. 

- For all 1 < i < n and < j < rrii, we have \uij\ = m and if j < rrii, then val(ujj_|_i) = 
val (uj J ) + 1. 

Assume now that x £ Uq satisfies one (and hence both) of the two properties from Fact 1 for 
some m. It follows that mj = 2™ — 1 for all 1 < i < n and 

2™-l 

X = a;i#X2# • • • Xn#, where Xj = hmm{j)aij for every 1 < i < n . (15) 

j=0 

In order to establish (b) we need additional structure. The idea is, for every counter value < 
j < 2"*, to have a word yj that coincides with x, but has all the occurrences of binm(j) marked. 
Then an automaton can check that successive occurrences of the counter binm(j) obey the 
transition condition of the Turing machine. There are two problems with this approach: first, 
in order to relate x and yj, we would need a binary relation of degree 2"^ (for arbitrary m) 
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and, secondly, an automaton cannot mark all the occurrences of biUmO) at once (for some 
j). In order to solve these problems, we introduce a binary relation fi, which for every x £ Uq 
as in (jlSp generates a binary tree of depth m with root x; this will be the only relation in our 
string automatic structure that causes exponential growth. This relation will mark in x every 
occurrence of an arbitrary counter. For this, we need two copies and of as well as two 
copies 1 and 1 of 1. For b G {0, 1}, define the mapping 

fb : {0,0, 1,T}*{0, 1}+ ^ {0,0, l,T}+{0, 1}* 

as follows (where u £ {0,0, 1,1}*, c G {0, 1}, and v G {0, 1}*): 

J ucv if 6 / c 
Mucv) = <_ 

I ucv n = c 

We extend to a function on (({0, 0,1, 1}*{0, 1}'^ as follows: Let w = wiai ■ ■ ■ W£ai 
with Wi £ {0, 0,1, 1}*{0, 1}"*" and G 17 U 17#. Then fb{w) = fbiwi)ai---fb{wi)af, this 
mapping can be computed with a synchronized transducer. Hence, the relation 

^^ = folJfi = {{u,h{u)) I uG (({0,0,l,Tr{0,l}+f2) + #r,6G {0,1}} 

can be recognized by a 2-dimensional automaton. 

Let X G Uq as in (llSp . let the word y be obtained from x by overlining or underlining 
each bit in x, and let u G {0, 1}™ be some counter. We say the counter u is marked in y if 
every occurrence of the counter u is marked by overlining each bit, whereas all other counters 
contain at least one underlined bit. 

Fact 2. Let x £ Uq be as in (fT5|) . 

— For all counters u G {0, 1}*", there exists a unique word y with {x,y) G /i™ such that the 
counter u is marked in y. 

— If {x,y) G /i™, then there exists a unique counter u G {0, 1}™ such that u is marked in y. 

Now, we can achieve our final goal, namely checking whether two successive configurations 
in a: G f7o represent a transition of the machine M. Let the counter u G {0, 1}*" be marked 
in y. We describe a finite automaton A2 that checks on the string y, whether at position 
val(ti) successive configurations in x are "locally consistent". The automaton A2 searches 
for the first marked counter in y. Then it stores the next three symbols 01,02,03 from f2 
(if the separator ^ is seen before, then only one or two symbols may be stored), walks 
right until it finds the next marked counter, reads the next three symbols 61, 62)^3 from 
and checks whether (010203,6162^3) G ajv/i where ajv/ is from (jlOp . If this is not the case, 
the automaton will reject, otherwise it will store 616263 and repeat the procedure described 
above. Let U2 = L{A2). Together with Fact 1 and 2, the behavior of A2 implies that for all 
x E Uq and all m G N, x represents an accepting 2'"-computation of M if and only if 

3yi,y2,y3 (^S{x,yi) a 0-^(2/1,2/2) a an{y2,yz) A yz£U^ A Vy ^/i"'(x,y) ^ y£U^ . 

Let us now fix some input w = 0102 • • • o„ G i7* with \w\ = n, and let o^+i = □ and m = 2". 
Thus, w is accepted by M if and only if there exists an accepting 2'"-computation x such that 
in the first configuration of x, the tape content is of the form tdD^. It remains to add some 
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structure that allows us to express the latter by a formula. But this is straightforward: Let > 
be a new symbol and let 77 = Z\ U {0,0,1, l,i>}; this is our final alphabet. Define the binary 
relations to,i fmd ia (a G f2) as follows: 

'•o,! = {iu> av,ua>v) \ a £ {0,1}, u,v £ A*, uav £ Uq} U {{Ov,0 > v) \ v £ A* ,0v £ Uq} 
i-a = {{u> av, ua> v) \ u,v £ A* ,uav £ Uq} . 

Then, A = (77* U (77*0 77*), 5, ctq, era, fi, 1^0,1, ita)a£n, Uq, Ui, U2) is a string automatic structure 
of bounded degree such that w is accepted by M if and only if the following formula is true 
in A: 

2/2,^3 (^Hx,yi) A cr^{yi,y2) A 0-^2(2/2,2/3) A 2/3 e f^i^ a 
3x£Uoi'^y - yef^a) A 

/ n+1 
32/0,^^0, ••• ,2/n+l,^;n+l( /-S^l (a:, 2/0) A Lq^^{yo,Zo) A /\ L}^-^^{zi^i,y^) A La,iyi,Zi) 



1=1 



By Lemma l4.ll we can compute in time 0(log(m)) = 0{n) an equivalent formula over the 
signature of A. This concludes the proof. □ 

The following theorem, which proves an analogous result for tree automatic structures, 
uses alternating Turing machines, see |6|26j for more details. Roughly speaking, an alternating 
Turing machine is a nondeterministic Turing machine, where the set of states is partitioned 
into accepting, existential, and universal states. A configuration is accepting, if either (i) the 
current state is accepting, or (ii) the current state is existential and at least one successor 
configuration is accepting, or (iii) the current state is universal and every successor configu- 
ration is accepting. By [6j, /cEXPTIME is the set of all problems that can be accepted in space 
exp(/c — l,n*^''^'*) on an alternating Turing machine (for all k > 1). 

Theorem 4.3. There exists a fixed tree automatic structure A of bounded degree such that 
FOTh(^) is 3EXPTIME-/iard. 

Proof. Let M be a fixed alternating Turing machine with a space bound of exp(2, n) such that 
M accepts a SEXPTIME-complete language. W.l.o.g. every configuration, where the current 
state is either existential or universal has exactly two successor configurations. Let U, F, Q, 
and Q have the same meaning as in the previous proof. Moreover, \ei A = Q\J {0, 1, #3, #v}- 
The idea is that a binary tree x over the alphabet A can encode a computation tree for 
some input. Configurations can be encoded by linear chains over the alphabet f2U {0, 1} as in 
the previous proof. The separator symbol 7^3 is used to separate an existential configuration 
from a successor configuration, whereas the separator symbol #v is used to separate a univer- 
sal configuration from its two successor configurations. Hence, a 7^3-labeled node has exactly 
one child, whereas a ^^v-labeled node has exactly two children. Checking whether the counters 
behave correctly can be done similarly to the previous proof by introducing binary relations 
(To and (Tq, which rotate symbols within configurations. Remember that in our tree encoding, 
configurations are just long chains. Also the marking of some specific counter can be done in 
the same way as before. Finally, having marked some specific counter allows to check with a 
top-down tree automaton, whether the tree x represents indeed a valid computation tree. Of 
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course, the tree automaton has to check whether the current configuration is existential or 
universal. In case of a universal configuration, the automaton branches at the next separator 
symbol #v If s.g. the current configuration is universal but the next separator symbol is 7^3, 



The proof of the next result is in fact a simplification of the proof of Theorem 14.21 since 
we do not need counters. 

Theorem 4.4. There exists a fixed string automatic structure A of bounded degree and poly- 
nomial growth (in fact linear growth) such that FOTh(^) is EXPSPACE-hard. 

Proof. Let M be a fixed Turing machine with a space bound of 2" such that M accepts an 
EXPSPACE-complete language. Let E, F, Q, qq, qf, □, and Q have the usual meaning. Let 
A = {#} U f2. This time, for m G N, an accepting m- computation is a string xi#X2# • • • Xnif, 
where xi,...,Xn G r*Qr~^ are configurations with \xi\ = m (1 < i < n), Xi \-m Xi-^-i 
(1 < i < n), xi G qoU*\Ji* , and Xn G r*qfr^. Let Uq be the fixed regular language 



The following binary relations 6 and can be easily recognized by 2-dimensional automata: 



Moreover, let Ui be the following regular language over A* fSi A*: 

Ui = {#u v# \ u,v e f2~^ ,\u\ = \v\,v \-M u}^{#u v# \ u,v e f2~^ ,\u\ = \v\} . 

Then, for every x G [/q and m G N we have: x is an accepting m-computation if and only if 
there exist 2/1,2/2 G Z\* Z\* such that 6{x,yi), a'^{yi,y2), and 2/2 G Ui. 

Let us now fix some input w = ai ■ ■ ■ an & with \w\ = n, let an+i = □, and let m = 2". 
Thus, w is accepted by M if and only if there exists an accepting m-computation x such that 
in the first configuration of x, the tape content is of the form wO^. It remains to add some 
structure that allows us to express the latter by a formula. This can be done similarly to 
the proof of Theorem 14.21 Let 77 = Z\ U {>}, where i> is a new symbol and define the binary 
relations La {a £ U L) {□}) as follows: 

'-a = {{Qoo-'fJ T QqcI' ^ \ V £ A* , qoav £ Uq} U {{uf> av,ua> v) \ u,v G A* ,uav £ Uq} 

Then, A = (77* U {A* ® A*), 6, gq, ('-a)ae i:u{n}; ^O; Ui) is a fixed string automatic structure of 
bounded degree and linear growth. For the latter note that the Gaifman graph of A is just a 
disjoint union of cycles and finite paths (in fact, every node has degree at most 2). Moreover, 
w is accepted by M if and only if the following statement is true in A: 



then the automaton rejects the tree. 



□ 



{r*Qr+#)+ n qoU*a*i^A* n z\*g/(zA \ {#})*# . 



6 = {{w, w 1^ w) \ W £ Uq} 
(^n = {(fl^^ ® w., va ® w) \ w £ Uq, a £ Q,v £ Z\*} 




(16) 



By Lemma l4. II this concludes the proof. 



□ 
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The next result can be easily shown by combining the techniques from the proof of The- 
orem [5]3] and 231 We leave the details for the reader. 

Theorem 4.5. There exists a fixed tree automatic structure A of bounded degree and poly- 
nomial growth (in fact linear growth) such that FOTh(^) is 2EXPTII\/lE-/iarti. 



5 Bounded quantifier alternation depth 



In this section we prove some facts about first-order fragments of fixed quantifier alternation 
depth. These results will follow easily from the constructions in the preceding section. 
For n > 0, Z'n-formulas and 7T„-formulas are inductively defined as follows: 

- A quantifier-free first-order formula is a i7o-formula as well as a TTo-formula. 

- If (p{xi, . . . ,Xn,yi, . . . ,ym) is a Z'„-formula, then Vxi • • • Vx^ : ip{xi, . . . , x„, yi, . . . , ym) is 
a 7T„-(_i-formula. 

- If ip{xi,...,Xn,yi,...,yni) is a 77„-formula, then Bxi • • • 3x„ : ip{xi, . . . ,Xn,yi, ■ ■ ■ ,ym) is 
a i7„+i-formula. 

The Z'n-theory Z'„-FOTh(^) of a structure A is the set of all Z'„-formulas in FOTh(^); the 
iln-theory is defined analogously. For a class C of tree automatic presentations, the Un-model 
checking problem Z'„-FOMC(C) of C denotes the set of all pairs {P,^p) where P G C, and 
if E i:„-FOTh(^(P)). 

The following result can be found in [5]: 

Theorem 5.1 (cf. [5]). The Ei-model checking problem Z'i-FOMC(SA) for all string auto- 
matic presentations is in PSPACE. Moreover, there is a fixed string automatic structure with 
a PSPACE- complete Ui-theory. 

From our construction in the proof of Theorem 14.41 we can slightly sharpen the lower 
bound in this theorem: 

Theorem 5.2. There exists a fixed string automatic structure of bounded degree and linear 
growth with a PSPACE- complete Ui-theory. 

Proof. Take the structure A from the proof of Theorem 14.41 and let M be a fixed linear 
bounded automaton with a PSPACE-complete acceptance problem. If we replace the number 
m in the formula ()16p by the input length n, then ()16p is equivalent to the following formula, 
which is equivalent to a i7i-formula: 



3yo,---,yn+i {5{x,yo) A /\aaiyi,yi+i) A y^+i e t/i j A 
3yi,...,y„Uai(a;,yi) A /\uaXyi-uyi) 

V i—0 



This formula is true in A if and only if the linear bounded automaton accepts the input 
w = ai ■ ■ ■ an- □ 

Let us now move on to i72-formulas and structures of arbitrary growth: 
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Theorem 5.3. The E2-model checking problem Z'2-F0MC(SA) for all string automatic pre- 
sentations is in EXPSPACE. Moreover, there is a string automatic structure of bounded degree 
with an EXPSPACE- complete IJ2-theory. 

Proof. For the upper bound, let P be a string automatic presentations of the automatic 
structure A{P) = A and let 

= 3xi--- 3j;„Vyi • • • Vy^ : 

be a i72-sentence. The sentence ^|J is equivalent to 

3x1 •• • 3a;„-.3yi • • • 3ym : -^(f ■ 

Negations in -k/j can be moved down to the level of atomic predicates. Then, we can built 
an (n + m)-dimensional automaton for -k/? with exp(l, IV'I'^'-^^) many states. Projection onto 
the tracks corresponding to the variables results again into an automaton with 

exp(l, IV'I'^^"^^) many states. Hence, for -^3yi ■ ■ ■ 3ym '■ there exists an n-dimensional au- 
tomaton with exp(2, IV'I'^'-^^) many states. But, we do not need to construct this automaton 
explicitly but only have to check emptiness of its language, which can be done on the fly in 
exponential space. 

For the lower bound, we reuse our construction from the proof of Theorem 14.21 We start 
with an exp(l, n)-space-bounded machine M that accepts an EXPSPACE-complete language. 
We carry out the same construction as in the proof of Theorem 14.21 but replace 2"^ (resp. 
m) everywhere by m (resp. the input length n). In addition, we need the following (trivial) 
analogue of Lemma l4.lt Let the signature S contain a binary symbol r. From a given number 
n (encoded unary), we can construct in linear time a i7i-formula , y) such that for every 

5-structure A and all elements a,b ^ A we have: (o, b) £ r" if and only if A |= (p^'^\a, b). 

Then, the final formula from the proof of Theorem 14.21 can be written as 

3yi,y2,y3 {^{x,yi) a cr^^\yi,y2) A aQ{y2,y3) A ys^Ui^ A 
3x£Uo\ (-/^^"Ha;,y) V y G A 

^yO,Zo,...,yn+l,Zn+lU''(!^l{x,yo) A iqo{yo,Zo) A /\ 4?i (zi_i , ?/i) A (^i , 2:^) j 
^ i=l ^ . 

This formula is equivalent to a Z'2-formula. Moreover, this formula is true in the string au- 
tomatic structure A (of bounded degree) from the proof of Theorem 14.21 if and only if the 
input w = a\a2 - • • an is accepted by the machine M. □ 

As before. Theorems 15 . IffSTSl can be extended to tree automatic structures as follows: 

Theorem 5.4. The following holds: 

1. The El-model checking problem i7i-F0MC(TA) for all tree automatic presentations is in 
EXPTIME. 

2. There exists a fixed tree automatic structure of bounded degree and linear growth with an 
EXPTW^E- complete Ui-theory. 

3. The 1^2 -mode/ checking problem i72-FOMC(TA) for all tree automatic presentations is in 
2EXPTIME. 

4. There exists a tree automatic structure of bounded degree with a 2EXPJ\ME- complete U2- 
theory. 
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6 Open problems 



The most obvious open question regards the uniform first-order theory for (injective) tree 
automatic structures: we do not know whether it is 4EXPTIME-hard. Moreover, we don't know 
an upper bound for the uniform first-order theory for arbitrary tree automatic structures. The 
reason is that we do not know the complexity of transforming such a presentation into an 
equivalent injective one (which is possible by [7j). 

In }5|19j , it is shown that not only the first-order theory of every string automatic structure 
is (uniformly) decidable, but even its extension by the quantifiers "there are infinitely many 
X with ..." and "the number of x satisfying ... is divisible by p". In [22], we proved that this 
extended theory can be decided in triply exponential time for (a')-automatic structures of 
bounded degree. It is not clear whether the doubly-exponential upper bound proved in this 
paper extends to this more expressive theory. 

Recall that there are tree automatic structures which are not string automatic. Provided 
2EXPSPACE 7^ 3EXPTIME, our results on the non-uniform first-order theories imply the exis- 
tence of such a structure of bounded degree (namely the tree automatic structure constructed 
in the proof of Theorem 14. 3p . But no example is known that does not rest on the complexity 
theoretic assumption 2EXPSPACE / 3EXPTIME. 

For n > 3, the precise complexity of the Z'n-theory of a string/tree automatic structure of 
bounded degree remains open. We know that these theories belong to 2EXPSPACE for string 
automatic structures and to 3EXPTIME for tree automatic structures. Moreover, from our re- 
sults for the 172-fragment we obtain lower bounds of EXPSPACE and 2EXPTIME, respectively. 

Conjecture 6.1. For every n > 3, the problems Z'„-FOMC(SAb) and Z'„-FOMC(TAb) belong 
to EXPSPACE and 2EXPTIME, respectively. 

A possible attack to this conjecture would follow the line of argument in the proof of Theo- 
rem 13.61 and would therefore be based on Gaifman's theorem. To make this work, the expo- 
nential bound in Gaifman's theorem would have to be reduced which leads to the following 
conjecture. 

Conjecture 6.2. Let ^ be a structure, (ai, . . . , Ofc), (6i, . . . , 6^) E A'^ , > 0, and Di, . . . , > 
d • 2" such that 

k k 
ai, . . . , ak) 

i=l i=l 

Then, for every Z'„-formula ip{xi, . . . , xt) of quantifier depth at most d, we have: 

A\= (p{ai,...,ak) <s=^ A\= Lp{bi,...,hk) . 
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